Apparatus and method for processing image

ABSTRACT

An image processing apparatus includes a display configured to display at least one screen; a communication interface configured to receive camera information from at least one camera; a processor configured to extract position information, time information, and image information corresponding to one another from the camera information and generate a first screen displaying the position information, a second screen displaying the time information, and a third screen for displaying the image information; and a user interface configured to receive a user input for selecting first position information from the position information or first time information from the time information, wherein the processor is further configured to extract first image information corresponding to the first position information or the first time information from the image information and reproduce the first image information through the third screen.

CROSS-REFERENCE TO THE RELATED APPLICATION

This application claims priority from Korean Patent Application No.10-2018-0025912, filed on Mar. 5, 2018, and Korean Patent ApplicationNo. 10-2019-0000862, filed on Jan. 3, 2019 in the Korean IntellectualProperty Office, the disclosures of which are incorporated herein intheir entirety by reference.

BACKGROUND 1. Field

One or more embodiments relate to an apparatus and a method forprocessing an image for object tracking.

2. Description of the Related Art

An image processing apparatus provides a user with an image acquired bya camera. At this time, the image processing apparatus may provide areal-time image or a recorded image to the user.

Meanwhile, the image processing apparatus may not only provide the userwith the whole recorded image, but may also provide a part of therecorded image to the user. The part of the recorded image may be acontinuous image or a summation of discontinuous images.

A user interface is needed to select and provide the user with the partof the recorded image.

SUMMARY

One or more exemplary embodiments of the inventive concept include anapparatus and a method for processing an image for object tracking.

Various aspects of the inventive concept will be set forth in part inthe description which follows and, in part, will be apparent from thedescription, or may be learned by practice of the presented embodiments.

According to one or more embodiments, there is provided an imageprocessing apparatus which may include: a display configured to displayat least one screen; a communication interface configured to receivecamera information from at least one camera; a processor configured toextract at least one position information, at least one timeinformation, and at least one image information corresponding to oneanother from the camera information; and generate a first screendisplaying the at least one position information, a second screendisplaying the at least one time information, and a third screen fordisplaying the at least one image information. The image processingapparatus may further include a user interface configured to receive auser input for selecting at least one of first position information fromthe at least one position information, and receive first timeinformation from the at least one time information, wherein theprocessor is further configured to extract, from the at least one imageinformation, first image information corresponding to at least one ofthe first position information and the first time information, andreproduce the first image information through the third screen.

The camera may be a movable camera.

The processor may be further configured to extract at least one objectfrom the at least one image information and generate a fourth screendisplaying the at least one object, and the user interface may befurther configured to receive a user input for selecting a first objectfrom the at least one object, and the processor may be furtherconfigured to extract second image information including the firstobject from the at least one image information and reproduce the secondimage information through the third screen.

The processor may be further configured to extract second positioninformation corresponding to the second image information from the atleast one position information or second time information correspondingto the second image information from the at least one time information,update the first screen such that the second position information isdisplayed thereon, and update the second screen such that the secondtime information is displayed thereon.

The at least one object may be at least one of a license plate number ofa vehicle, a face, a voice, and a sound having a predeterminedfrequency.

According to one or more embodiments, there is provided an imageprocessing apparatus which may include: a database storing cameraposition information; a display configured to display at least onescreen; a communication interface configured to receive first camerainformation from at least one first camera configured to recognize anobject, and receive second camera information from at least one secondcamera not configured to recognize the object; and; and a processorconfigured to: extract, from the first camera information, at least onefirst camera position information, at least one first camera timeinformation, and at least one first camera image informationcorresponding to one another; extract, from the database, at least onesecond camera position information indicating a position of the at leastone second camera positioned within a predetermined distance from aposition of the at least one first camera indicated by the at least onefirst camera position information; extract, from the second camerainformation, at least one second camera time information and at leastone second camera image information corresponding to the at least onesecond camera position information; and generate a first screendisplaying the at least one first camera position information and the atleast one second camera position information, a second screen displayingthe at least one first camera time information and the at least onesecond camera time information, and a third screen for displaying the atleast one first camera image information or the at least one secondcamera image information.

The object may be at least one of a license plate number of a vehicle, aface, a voice, and a sound having a predetermined frequency.

The at least one first camera and the at least one second camera may bestationary cameras.

The at least one first camera position information and the at least onesecond camera position information may be displayed distinguishably fromeach other on the first screen.

The at least one first camera time information and the at least onesecond camera time information may be displayed distinguishably fromeach other on the second screen.

The processor may be further configured to: extract the object from theat least one first camera image information; determine a movingdirection of the object; and extract, from the database, the at leastone second camera position information indicating a position of the atleast one second camera positioned within the predetermined distance inthe moving direction of the object from a position of the at least onefirst camera indicated by the at least one first camera positioninformation.

The image processing apparatus may further include a user interfaceconfigured to receive a user input for selecting an area other than anarea of the at least one first camera position information on the firstscreen, wherein the processor is further configured to extract, from thedatabase, the at least one second camera position informationcorresponding to the selected area, in response to the user input.

The image processing apparatus may further include a user interfaceconfigured to receive a user input for selecting an area other than anarea of the at least one first camera time information on the secondscreen, wherein the processor is further configured to extract, from thedatabase, the at least one second camera position informationcorresponding to the selected area, in response to the user input.

The image processing apparatus may further include a user interfaceconfigured to receive a first user input for selecting the at least onefirst camera position information or the at least one second cameraposition information displayed on the first screen, and a second userinput for selecting the at least one first camera time information orthe at least one second camera time information displayed on the secondscreen, wherein the processor is further configured to reproduce the atleast one first camera image information or the at least one secondcamera image information through the third screen in response to thefirst user input, and reproduce the at least one first camera imageinformation or the at least one second camera image information throughthe third screen in response to the second user input.

According to one or more embodiments, there is provided an imageprocessing method which may include: storing camera position informationin a database; receiving first camera information from at least onefirst camera capable of recognizing an object, and receiving secondcamera information from at least one second camera not configured torecognize the object, by using a communication interface; extracting,from the first camera information, at least one first camera positioninformation, at least one first camera time information, and at leastone first camera image information corresponding to one another, byusing a processor; extracting, from the database, at least one secondcamera position information indicating a position of the at least onesecond camera positioned within a predetermined distance from a positionof the at least one first camera position indicated by the at least onefirst camera position information, by using the processor; extracting,from the second camera information, at least one second camera timeinformation and at least one second camera image informationcorresponding to the at least one second camera position information, byusing the processor; and generating a first screen displaying positioninformation comprising the at least one first camera positioninformation, a second screen displaying time information comprising theat least one first camera time information, and a third screen fordisplaying the at least one first camera image information, by using theprocessor.

The object may be at least one of a license plate number, a face, avoice, and a sound having a predetermined frequency.

The at least one first camera and the at least one second camera may bestationary cameras.

The at least one first camera position information and the at least onesecond camera position information may be displayed distinguishably fromone another on the first screen.

The at least one first camera time information and the at least onesecond camera time information may be displayed distinguishably fromeach other on the second screen.

The at least one position information may displayed in a form of a map.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other aspects will become apparent and more readilyappreciated from the following description of the embodiments, taken inconjunction with the accompanying drawings, in which:

FIG. 1 is a diagram for explaining a security system according to anembodiment;

FIG. 2 is a block diagram showing a configuration of an image processingapparatus according to an embodiment;

FIG. 3 is a flowchart illustrating an image processing method accordingto an embodiment;

FIG. 4 is a diagram illustrating a screen of an image processingapparatus according to an embodiment;

FIG. 5 is a flowchart illustrating an image processing method accordingto an embodiment;

FIGS. 6A and 6B are flowcharts for explaining an image processing methodaccording to an embodiment;

FIG. 7 is a diagram illustrating a screen of an image processingapparatus according to an embodiment;

FIG. 8 is a flowchart illustrating an image processing method accordingto an embodiment;

FIG. 9 is a diagram illustrating a screen of an image processingapparatus according to an embodiment;

FIG. 10 is a flowchart illustrating an image processing method accordingto an embodiment;

FIG. 11 is a flowchart illustrating an image processing method accordingto an embodiment;

FIG. 12 is a diagram showing a screen of an image processing apparatusaccording to an embodiment; and

FIG. 13 is a flowchart illustrating an image processing method accordingto an embodiment.

DETAILED DESCRIPTION

Reference will now be made in detail to embodiments which areillustrated in the accompanying drawings, wherein like referencenumerals refer to like elements throughout. It is to be noted that theembodiments presented herein are all exemplary, and, these embodimentsmay have different forms and should not be construed as being limited tothe descriptions set forth herein. As used herein, expressions such as“at least one of,” when preceding a list of elements, modify the entirelist of elements and do not modify the individual elements of the list.For example, the expression, “at least one of a, b, and c,” should beunderstood as including only a, only b, only c, both a and b, both a andc, both b and c, or all of a, b, and c.

The embodiments presented herein are not intended to limit the inventiveconcept to particular modes of practice, and it is to be appreciatedthat all changes, equivalents, and substitutes that do not depart fromthe spirit and technical scope of the inventive concept are encompassedin the present disclosure. In the description of the present disclosure,certain detailed explanations of the related art are omitted when it isdeemed that they may unnecessarily obscure the essence of thedisclosure.

While such terms as “first,” “second,” etc., may be used to describevarious components, such components must not be limited to the aboveterms. The above terms are used only to distinguish one component fromanother. An embodiment provided in the following description is notexcluded from being associated with one or more features of anotherexample or another embodiment also provided herein or not providedherein but consistent with the inventive concept. For example, even ifmatters described in a specific example are not described in a differentexample thereto, the matters may be understood as being related to orcombined with the different example, unless otherwise mentioned indescriptions thereof.

In the present disclosure, it is to be understood that the terms such as“including”, “having,” and “comprising” are intended to indicate theexistence of the features, numbers, steps, actions, components, parts,or combinations thereof disclosed in the specification, and are notintended to preclude the possibility that one or more other features,numbers, steps, actions, components, parts, or combinations thereof mayexist or may be added.

The present disclosure may be described in terms of functional blockcomponents and various processing steps. Such functional blocks may berealized by any number of hardware and/or software components configuredto perform the specified functions. For example, the present disclosuremay employ various integrated circuit (IC) components, e.g., memoryelements, processing elements, logic elements, look-up tables, and thelike, which may carry out a variety of functions under the control ofone or more microprocessors or other control devices. Similarly, wherethe elements of the present disclosure are implemented using softwareprogramming or software elements, the disclosure may be implemented withany programming or scripting language such as C, C++, Java, assemblerlanguage, or the like, with the various algorithms being implementedwith any combination of information structures, objects, processes,routines or other programming elements. Functional aspects may beimplemented in algorithms that are executed on one or more processors.Furthermore, the present disclosure could employ any number ofconventional techniques for electronics configuration, signal processingand/or control, information processing and the like. The words“mechanism”, “element”, “means”, and “configuration” are used broadlyand are not limited to mechanical or physical embodiments, but mayinclude software routines in conjunction with processors, etc.

Hereinafter, various embodiments of the inventive concept will bedescribed in detail with reference to the accompanying drawings.

FIG. 1 is a diagram for explaining a security system according to anembodiment.

Referring to FIG. 1, a security system 1 according to an embodimentincludes a camera 10, a network 20, a server 30, and a monitoringterminal 40.

The security system 1 provides a configuration in which when informationof the camera 10 is transmitted to the server 30 over the network 20, auser monitors the information transmitted to the server 30 by using themonitoring terminal 40.

The camera 10 includes a movable camera 11 and a stationary camera 12.

The movable camera 11 may be carried by a person or installed in avehicle. A surveillance area of the movable camera 11 may be fixed ormay change in accordance with a movement of the movable camera 11.

The movable camera 11 may be driven by a regular power or by a battery.For example, the movable camera 11 installed in the vehicle may besupplied with a regular power from the vehicle, and the movable camera11 separated from the vehicle may be driven by a battery.

The movable camera 11 may capture images of the surveillance area at alltimes or may maintain a sleep mode at normal times and switch to anactive mode only when an event occurs and then capture images of thesurveillance area.

The stationary camera 12 may be installed in a street. An installationarea of the stationary camera 12 may not change. At this time, asurveillance area of the stationary camera 12 may be fixed or changed.

The stationary camera 12 may be a pan/tilt/zoom (PTZ) camera. The PTZcamera may be a camera capable of panning and tilting and adjusting thezoom magnification of a lens. A surveillance area of the PTZ camera maybe changed according to panning, tilting, and/or zoom magnificationcontrol of the PTZ camera.

The stationary camera 12 may be driven by a regular power or a battery.

The stationary camera 12 may photograph the surveillance area at alltimes or may photograph the surveillance area only when an event occurs.

For example, the PTZ camera may maintain the sleep mode at normal timesand may periodically wake up to check whether the event has occurred.The PTZ camera may switch to the active mode when the event occurs,capture an image, and return to the sleep mode again when the event doesnot occur.

The camera 10 may generate position information and time informationbased on a Global Positioning System (GPS) signal received through a GPSmodule (not shown). The GPS module (not shown) may be provided in thecamera 10 or separately from the camera 10, but is not limited thereto.

The position information indicates a position of the camera 10. Forexample, the position information may include GPS coordinate informationabout the camera 10. The time information indicates a time or a timepoint.

The camera 10 generates camera information including positioninformation, time information, and image information corresponding toone another. That is, the camera information includes an image capturedat a predetermined position at a predetermined time point.

The camera 10 transmits the camera information to the server 30 over thenetwork 20.

The camera 10 may recognize an object. The camera 10 may recognize, forexample, a license plate number of a vehicle, a face, a voice, a soundhaving a predetermined frequency, and the like, but is not limitedthereto. The camera 10 capable of recognizing the object may distinguishand generate camera information in which the object is recognized andcamera information in which the object is not recognized.

The camera 10 may generate camera information without regard torecognition of the object. In this case, the camera 10 may generatecamera information in which the object is recognized and camerainformation in which the object is not recognized, without anydistinction.

The network 20 may include a wired network or a wireless network. Thewireless network may be a 2G or 3G cellular communication system, a 3rdGeneration Partnership Project (3GPP), a 4G communication system, aLong-Term Evolution (LTE), or a World Interoperability for MicrowaveAccess (WiMAX).

The server 30 may transmit camera information transmitted from thecamera 10 over the network 20 to the monitoring terminal 40 and generatecommands based on a user input from the monitoring terminal 40 and thentransmit the commands to the camera 10 over the network 20.

The monitoring terminal 40 may reproduce and store the camerainformation transmitted from the server 30. For example, the monitoringterminal 40 displays an image transmitted from the server 30.

The monitoring terminal 40 may receive a user input and transmit theuser input to the server 30. The user input may be a predeterminedposition in a map, a predetermined position at a time bar, or a userinput for selecting a predetermined object.

The monitoring terminal 40 may include at least one or more processors.The monitoring terminal 40 may be driven by being included in anotherhardware device having a microprocessor or a general purpose computersystem. The monitoring terminal 40 may be a personal computer or amobile terminal.

FIG. 2 is a block diagram showing a configuration of an image processingapparatus according to an embodiment.

Referring to FIG. 2, an image processing apparatus 200 according to anembodiment includes a display 210, a communication interface 220, aprocessor 230, a user interface 240, and a database 250.

The display 210 displays at least one screen.

The communication interface 220 receives camera information from thecamera 10 of FIG. 1. The camera 10 may be the movable camera 11.

The processor 230 extracts position information, time information, andimage information corresponding to one another from the camerainformation, and generates a first screen including a map displaying theposition information, a second screen including a time bar displayingthe time information, and a third screen for displaying the imageinformation. The processor 230 also extracts, from the imageinformation, first image information corresponding to at least one offirst position information and first time information in response to auser input information, and reproduces the first image informationthrough a third screen.

The processor 230 may extract at least one object from the imageinformation and generate a fourth screen displaying the object.

The object may be at least one of a license plate number of a vehicle, aface, a voice, and a sound having a predetermined frequency.

The processor 230 may extract, from the image information, second imageinformation including a first object information in response to a userinput for selecting the first object from the object through the fourthscreen, and reproduce the second image information through the thirdscreen.

At this time, the processor 230 may extract second position informationcorresponding to the second image information from the positioninformation and/or extract second time information corresponding to thesecond image information from the time information, and update the firstscreen such that the second position information is displayed on the mapand/or update the second screen such that the second time information isdisplayed on the time bar.

Accordingly, the image processing apparatus 200 according to anembodiment may provide the user with the map indicating a position wherea selected object is photographed according to a user input through thefirst screen, the time bar representing a time point at which theselected object is photographed according to a user input through thesecond screen, and an image obtained by photographing the selectedobject according to a user input through the third screen and theselected object according to a user input through the fourth screen.

The processor 230 extracts, from the first camera information receivedfrom a first camera such as the camera 10, first camera positioninformation, first camera time information, and first camera imageinformation corresponding to one another. The processor 230 alsoextracts, from the database 250, second camera position informationindicating a position of a second camera such as the camera 10positioned within a predetermined distance from a position of the firstcamera indicated by the first camera position information. The processor230 further extracts, from second camera information received from thesecond camera, second camera time information and second camera imageinformation corresponding to the second camera position information, andgenerates a first screen including a map displaying the first cameraposition information and the second camera position information, asecond screen including a time bar displaying the first camera timeinformation and the second camera time information, and a third screenfor displaying the first camera image information or the second cameraimage information.

In the descriptions below, the term “first (second, third, or fourth)camera information” refers to information about the first, second,third, or fourth camera, respectively. Also, the term “first (second,third, or fourth) camera position information” refers to informationabout a position of the first (second, third, or fourth) camera, theterm “first (second, third, or fourth) camera time information” refersto information about a time point of the first (second, third, orfourth) camera, and the term “first (second, third, or fourth) cameraimage information” refers to the image information of the first (second,third, or fourth) camera. Further, the term “at least one position (timeor image) information” refers to information about at least one position(time (or time point) or image).

The user interface 240 receives a user input for selecting the firstposition information from the position information or the first timeinformation from the time information.

The user interface 240 may receive a user input for selecting the firstobject from the object.

The database 250 stores the position information about the camera 10.The database 250 may store the first camera position information and thesecond camera position information.

The communication interface 220 receives the first camera informationfrom a first camera configured to recognize the object, and receives thesecond camera information from a second camera not configured torecognize the object.

The object may be at least one of the license plate number of thevehicle, the face, the voice, and the sound having the predeterminedfrequency.

The first camera information may include an image captured by the firstcamera at a predetermined time point at a predetermined position.

The second camera information may include an image captured by thesecond camera at a predetermined time point at a predetermined position.

The processor 230 extracts the first camera position information, thefirst camera time information, and the first camera image informationcorresponding to one another from the first camera information. Theprocessor 230 also extracts, from the database 250, the second cameraposition information indicating a position of the second camerapositioned within a predetermined distance from a position of the firstcamera indicated by the first camera position information. The processor230 further extracts, from the second camera information, the secondcamera time information and the second camera image informationcorresponding to the second camera position information, and generates afirst screen including a map displaying the first camera positioninformation and the second camera position information, a second screenincluding a time bar displaying first camera time information and thesecond camera time information, and a third screen for displaying thefirst camera image information or the second camera image information.

The processor 230 extracts at least one object from the first cameraimage information, determine a movement direction of the object, andextract, from the database 250, the second camera position informationindicating a position of the second camera positioned within apredetermined distance in the movement direction of the object from aposition of the first camera indicated by the first camera positioninformation.

Accordingly, the image processing apparatus 200 according to anembodiment provides not only an image of an object photographed by thefirst camera capable of recognizing the object, but also an image of theobject photographed by the second camera incapable of recognizing theobject, thereby providing a more reinforced object tracking function.

The processor 230 may extract the second camera position information inresponse to a user input for selecting an area other than an area in themap where the first camera position information is displayed.

The processor 230 may extract the second camera position information inresponse to a user input for selecting an area other than an area at thetime bar where the e first camera time information is displayed.

Each of the first camera and the second camera are one or more. Thefirst camera and the second camera may be stationary cameras 12.

When there are a plurality of first cameras, for example, each firstcamera may generate the first camera information including at least oneimage obtained by photographing an object recognized by the firstcamera.

When there are a plurality of second cameras, for example, a secondcamera may generate the second camera information including an imageobtained by photographing the object recognized by the first camera, andanother second camera may generate the second camera informationincluding an image obtained by not photographing the object recognizedby the first camera.

The first camera position information and the second camera positioninformation may be displayed to be distinguished from each other on themap.

The first camera time information and the second camera time informationmay be displayed to be distinguished from each other on the time bar.

The processor 230 may reproduce the first camera image information inresponse to a first user input for selecting the first camera positioninformation on the map through the third screen, or reproduce the secondcamera image information in response to a second user input forselecting the second camera position information on the map through thethird screen.

The processor 230 may extract at least one object from the first cameraimage information, and generate the fourth screen displaying the object.

The processor 230 may extract third camera image information includingthe first object selected according to a user input through the firstscreen from the first camera image information, and fourth camera imageinformation including the first object from the second camera imageinformation, and reproduce the third camera image information and thefourth camera image information through the third screen.

Accordingly, the image processing apparatus 200 according to anembodiment may provide the user with the map indicating a position wherethe selected object is photographed according to a user input throughthe first screen, the time bar representing a time at which the selectedobject is photographed according to a user input through the secondscreen, and an image obtained by photographing the selected objectaccording to a user input through the third screen, and the selectedobject according to a user input through the fourth screen.

The user interface 240 may receive a user input for selecting an areaother than an area of the map where the first camera positioninformation is displayed.

The user interface 240 may receive a user input for selecting an areaother than an area of the time bar where the first camera timeinformation is displayed.

The user interface 240 may receive the first user input for selectingthe first camera position information displayed on the map or the seconduser input for selecting the second camera position informationdisplayed on the map.

The user interface 240 may receive a user input for selecting the firstobject from the at least one object.

The image processing apparatus 200 according to the embodiments may beimplemented as one physical device or a plurality of physical devicesorganically combined with each other. To this end, some of thecomponents included in the image processing apparatus 200 may beimplemented or installed as any one physical device, and the othercomponents may be implemented or installed as other physical devices.

Meanwhile, the image processing apparatus 200 may be embedded in thecamera 10, the server 30 or the monitoring terminal 40 or may be appliedto a device separately from the camera 10, the server 30, or themonitoring terminal 40.

Hereinafter, an operation of the image processing apparatus 200according to an embodiment will be described in detail with reference toFIGS. 3 to 7.

FIG. 3 is a flowchart illustrating an image processing method accordingto an embodiment.

FIG. 4 is a diagram illustrating a screen of an image processingapparatus, according to an embodiment.

Referring to FIG. 4 along with FIG. 2, the display 210 of the imageprocessing apparatus 200 may display a screen 400 including a firstscreen 410, a second screen 420, a third screen 430, and a fourth screen440.

Referring to FIGS. 1 to 4, the communication interface 220 receivescamera information from the camera 10 (S310). The camera 10 may be, forexample, the movable camera 11 mounted on a vehicle.

The processor 230 extracts, from the camera information, positioninformation, time information, and image information corresponding toone another (S320).

The position information may include, for example, first, second, thirdand fourth position information P1A, P2A, P3A and P4A. The timeinformation may include, for example, first, second, third and fourthtime information T1A, T2A, T3A and T4A. The image information mayinclude, for example, first, second, third and fourth image information.

Here, the first position information P1A, the first time informationT1A, and the first image information may correspond to one another, andthe second position information P2A, the second time information T2A,and the second image information may correspond to one another, thethird position information P3A, the third time information T3A and thethird image information may correspond to one another, and the fourthposition information P4A, the fourth time information T4A, and thefourth image information may correspond to one another. In other words,the first, second, third and fourth images may be obtained by the camera10 at the first, second, third and fourth positions P1A, P2A, P3A andP4A at the first, second, third and fourth time points T1A, T2A, T3A andT4A, respectively.

Thereafter, the processor 230 generates the first screen 410 including amap displaying the position information, the second screen 420 includinga time bar displaying the time information, and the third screen 430 fordisplaying the image information (S330).

For example, the processor 230 may generate the first screen 410including the map displaying the first, second, third and fourthposition information P1A, P2A, P3A and P4A, the second screen 420including the time bar displaying the first, second, third and fourthtime information T1A, T2A, T3A and T4A, and the third screen 430 fordisplaying image information from among the first, second, third andfourth image information, according to a user input.

Then, the user interface 240 receives a user input for selecting firstposition information from the position information (S341).

For example, the user interface 240 may receive a first user input U1Afor selecting the first position P1A from the first, second, third andfourth positions P1A, P2A, P3A and P4A displayed on the first screen410.

The processor 230 extracts first image information corresponding to thefirst position information from the image information, according to auser input (S351).

For example, the processor 230 may extract the first image correspondingto the first position P1A from the first, second, third and fourthimages, according to the first user input U1A.

Meanwhile, the user interface 240 receives a user input for selectingfirst time information from the time information (S342).

For example, the user interface 240 may receive a second user input U2Afor selecting the first time point T1A from the first, second, third andfourth time points T1A, T2A, T3A and T4A displayed on the second screen420.

The processor 230 extracts first image information corresponding to thefirst time information from the image information, according to a userinput (S352).

For example, the processor 230 may extract the first image correspondingto the first time point T1A from the first, second, third and fourthimages, according to the second user input U2A.

The processor 230 reproduces an extracted image, that is, the firstimage, through the third screen 430 (S360).

FIG. 5 is a flowchart illustrating an image processing method accordingto an embodiment.

Referring to FIGS. 1, 2, 4, and 5, the processor 230 extracts at leastone object from at least one image (S510).

For example, the processor 230 extracts first, second and third objectsO1A, O2A and O3A from first, second, third and fourth image information.The first object O1A may be a predetermined license plate number of avehicle. The second object O2A may be a predetermined face. The thirdobject O3A may be a predetermined sound. However, the inventive conceptis not limited thereto, and thus, different types of object may beextracted by the processor 230.

Then, the processor 230 generates the fourth screen 440 displaying theextracted object (S520).

For example, the processor 230 may display the first, second, and thirdobjects O1A, O2A and O3A on the fourth screen 440.

Then, the user interface 240 receives a user input for selecting thefirst object from the extracted object (S530).

For example, the user interface 240 may receive a third user input U3Afor selecting the first object O1A from the first, second and thirdobjects O1A, O2A and O3A.

Then, the processor 230 extracts second image information including thefirst object from the image information (S540).

For example, the processor 230 may extract the first, second and thirdimage information including the first object O1A from the first, second,third and fourth image information.

Then, the processor 230 reproduces the extracted image informationthrough the third screen 430 (S550).

For example, the processor 230 may sequentially reproduce the first,second and third image information including the first object O1Athrough the third screen 430.

FIGS. 6A and 6B are flowcharts for explaining an image processing methodaccording to an embodiment.

FIG. 7 is a diagram illustrating a screen of an image processingapparatus, according to an embodiment.

Referring to FIGS. 1, 2, 6A, and 7, when the user interface 240 receivesa user input for selecting a first object from at least one object(S611), and the processor 230 extracts second image informationincluding the first object from at least one image information capturedby the camera 10 (S612), the processor 230 extracts second positioninformation corresponding to the second image information from at leastone position information (S613).

For example, when the user interface 240 receives a fourth user inputU4A for selecting the first object O1A and the processor 230 extractsfirst, second and third image information which include the first objectO1A, the processor 230 may extract, from the at least one positioninformation, the first, second and third position information P1A, P2Aand P3A corresponding to the first, second and third image information,respectively.

At this time, the processor 230 may update a fourth screen 740 such thatthe second and third objects O2A and O3A which are not selected are notdisplayed thereon in response to the fourth user input U4A for selectingthe first object O1A.

Thereafter, the processor 230 updates a first screen 710 such that thesecond position information is displayed on a map (S614).

For example, the processor 230 may update the first screen 710 such thatthe first, second and third position information P1A, P2A and P3A aredisplayed on the map. Accordingly, the fourth position information P4A,at which the fourth image information not including the first object O1Ais photographed, may be excluded from the updated first screen 710.

Referring to FIGS. 1, 2, 6B, and 7, when the user interface 240 receivesa user input for selecting the first object from the at least one object(S621), and the processor 230 extracts the second image informationincluding the first object from the at least one image informationcaptured by the camera 10 (S622), the processor 230 extracts timeinformation corresponding to the second image information from at leastone time information (S623).

For example, when the user interface 240 receives the fourth user inputU4A for selecting the first object O1A, and the processor 230 extractsthe first, second and third image information including the first objectO1A, the processor 230 may extract, from the at least one timeinformation, the first, second and third time information T1A, T2A andT3A corresponding to the first, second and third image information,respectively.

At this time, the processor 230 may update the fourth screen 740 suchthat the second and third objects O2 a and O3 a which are not selectedare not displayed thereon in response to the fourth user input U4A forselecting the first object O1A.

Thereafter, the processor 230 updates the second screen 720 such thatthe second time information is displayed on a time bar (S624).

For example, the processor 230 may update the second screen 720 suchthat the first, second and third time information T1A, T2A and T3A aredisplayed on the time bar. Accordingly, the fourth time information T4Aat which the fourth image information not including the first object O1Ais photographed, may be excluded from the updated second screen 720.

That is, the image processing apparatus 200 may provide a user with thefirst object O1A selected by the user through the fourth screen 740, themap indicating the first, second and third position information P1A, P2Aand P3A obtained by photographing the first object O1A through the firstscreen 710, the time bar representing the first, second and third timeinformation T1A, T2A and T3A obtained by photographing the first objectO1A through the second screen 720, and the first, second and third imageinformation obtained by photographing the first object O1A through thethird screen 730.

FIG. 8 is a flowchart illustrating an image processing method accordingto an embodiment.

FIG. 9 is a diagram illustrating a screen of an image processingapparatus, according to an embodiment.

Referring to FIGS. 1, 2, 8, and 9, the database 250 stores positioninformation about the camera 10 (S810).

The camera 10 may be, for example, the stationary camera 12 installed ina building.

The database 250 may store, for example, first camera positioninformation indicating a position of a first camera and second cameraposition information indicating a position of a second camera. The firstcamera and the second camera may be different cameras 10, and the firstcamera position information and the second camera position informationmay be different from each other.

The communication interface 220 receives first camera information fromthe first camera configured to recognize an object (S820).

The processor 230 extracts at least one first camera positioninformation, at least one first camera time information, and at leastone first camera image information corresponding to one another from thefirst camera information (S830). Here, the at least one first camera maybe stationary or fixed cameras like the stationary camera 12.

The at least one first camera position information may be, for example,11^(th) camera position information P11B and 12^(th) camera positioninformation P12B. The at least one first camera time information may be,for example, 11^(th) camera time information T11B and 12^(th) cameratime information T12B. The first camera image information may be, forexample, 11^(th) camera image information and 12^(th) camera imageinformation. Here, the 11^(th) and 12^(th) cameras may be stationary orfixed cameras.

At this time, the 11^(th) camera position information P11B, the 11^(th)camera time information T11B and the 11^(th) camera image informationmay correspond to one another, and the 12^(th) camera positioninformation P12B, the 12^(th) camera time information T12B, and the12^(th) camera image information may correspond to one another.

Then, the processor 230 extracts, from the database 250, at least onesecond camera position information indicating a position of the at leastone second camera positioned within a predetermined distance from aposition of the at least one first camera indicated by the at least onefirst camera position information (S840).

In other words, the processor 230 extracts, from position informationstored in the database 250, information about a position of at least onesecond camera positioned within a predetermined distance from a positionof the at least one first camera. Here, the at least one second cameramay be stationary or fixed cameras like the stationary camera 12.

For example, the processor 230 may extract 21^(st) camera positioninformation P21B positioned at a first distance D1 from the 11^(th)camera position information P11B and 22^(nd) camera position informationP22B positioned at a second distance D2 from the 12^(th) camera positioninformation P12B from the database 250. At this time, each of the firstdistance D1 and the second distance D2 may be smaller than apredetermined distance. Here, the 21^(st) and 22^(nd) cameras may bestationary or fixed cameras.

Hereinafter, a method of extracting at least one second camera positionaccording to an embodiment will be described with reference to FIG. 10.

FIG. 10 is a flowchart illustrating an image processing method accordingto an embodiment.

Referring to FIGS. 1, 2, 9, and 10, the processor 230 extracts an objectfrom at least one first camera image information (S1041).

For example, the processor 230 may extract a predetermined license platenumber of a vehicle from 11^(th) camera image information.

For example, the processor 230 may extract the predetermined licenseplate number of the vehicle from 12^(th) camera image information.

Then, the processor 230 determines a moving direction of the object(S1042).

For example, the processor 230 may determine a moving speed of a vehiclehaving the predetermined license plate number. That is, the processor230 may determine a moving distance and the moving direction of thevehicle having the predetermined license plate number.

The moving direction of the vehicle having the predetermined licenseplate number obtained from the 11^(th) camera image information may be,for example, a southeast direction.

The moving direction of the vehicle having the predetermined licenseplate number obtained from the 12^(th) camera image information may be,for example, a northeast direction.

Then, the processor 230 extracts, from the database 250, second cameraposition information indicating a position of the at least one secondcamera positioned within a predetermined distance in the movingdirection of the at least one object from a position of the first cameraindicated by the first camera position information (S1043).

For example, the processor 230 may extract the 21^(st) camera positioninformation P21B that is away from the 11^(th) camera positioninformation P11B by the first distance D1 in the southeast direction.

For example, the processor 230 may extract the 22^(nd) camera positioninformation P22B that is away from the 12^(th) camera positioninformation P12B by the second distance D2 in the northeast direction.

Referring to FIGS. 1, 2, 8 and 9 again, the communication interface 220receives the second camera information from a second camera that is notconfigured to recognize the object (S850).

The processor 230 extracts, from the second camera information, at leastone second camera time information and at least one second camera imageinformation corresponding to at least one second camera positioninformation (S860).

The at least one second camera time information may be, for example,21^(st) camera time information T21B and 22^(nd) camera time informationT22B. The at least one first camera image information may be, forexample, 21^(st) camera image information and 22^(nd) camera imageinformation.

The processor 230 then generates a first screen 910 including a mapdisplaying the at least one first camera position information and the atleast one second camera position information, a second screen 920including a time bar displaying the at least one first camera timeinformation and at least one second camera time information, and a thirdscreen 930 for displaying the at least one first camera imageinformation or the at least one second camera image information (S870).

The at least one first camera position information and the at least onesecond camera position information are displayed to be distinguishedfrom each other on the map.

For example, the processor 230 may display the 11^(th) camera positioninformation P11B, the 12^(th) camera position information P12B, the21^(st) camera position information P21B, and the 22^(nd) cameraposition information P22B on the map of the first screen 910. At thistime, the 11^(th) camera position information P11B and the 12^(th)camera position information P12B may be displayed as circular shapes,and the 21^(st) camera position information P21B and the 22^(nd) cameraposition information P22B may be displayed as triangular shapes.

The at least one first camera time information and the at least onesecond camera time information are displayed to be distinguished fromeach other on the time bar.

For example, the processor 230 may display the 11^(th) camera timeinformation T11B, the 12^(th) camera time information T12B, the 21^(st)camera time information T21B, the 22^(nd) camera time information T22Bon the time bar of the second screen 920. At this time, the 11^(th)camera time information T11B and the 12^(th) camera time informationT12B may be displayed in different colors from the 21^(st) camera timeinformation T21B and the 22^(nd) camera time information T22B.

FIG. 11 is a flowchart illustrating an image processing method accordingto an embodiment.

FIG. 12 is a diagram showing a screen of an image processing apparatusaccording to an embodiment.

Referring to FIGS. 1, 2, 11, and 12, the database 250 stores positioninformation about the camera 10 (S1110).

The communication interface 220 receives first camera information from afirst camera configured to recognize the object (S1120).

The processor 230 extracts at least one first camera positioninformation, at least one first camera time information, and at leastone first camera image information corresponding to one another from thefirst camera information (S1130).

The at least one first camera position information may be, for example,the 11^(th) camera position information P11B and the 12^(th) cameraposition information P12B. The at least one first camera timeinformation may be, for example, the 11^(th) camera time informationT11B and the 12^(th) camera time information T12B. The at least onefirst camera image information may be, for example, the 11^(th) cameraimage information and the 12^(th) camera image information.

The 11^(th) camera position information P11 b, the 11^(th) camera timeinformation T11 b, and the 11^(th) camera image information maycorrespond to one another. The 12^(th) camera position information P12b, 12^(th) camera time information T12 b, and the 12^(th) camera imageinformation may correspond to one another.

The processor 230 generates a first screen 1210 including a mapdisplaying the at least one first camera position information, a secondscreen 1220 including a time bar displaying the at least one firstcamera time information, and a third screen 1230 for displaying the atleast one first camera image information (S1140).

For example, the processor 230 may display the 11^(th) camera positioninformation P11B and the 12^(th) camera position information P12B on themap of the first screen 1210 and the 11^(th) camera time informationT11B and the 12^(th) camera time information T12B on the time bar of thesecond screen 1220.

Then, the user interface 240 receives a user input for selecting an areaother than an area of the map where the first camera positioninformation is displayed (S1151).

For example, the user interface 240 receives a sixth user input U6B forselecting an area between the eleventh camera position information P11Band the 12^(th) camera position information P12B of the first screen1210.

The processor 230 extracts, from the database 250, the second cameraposition information corresponding to the user input (S1161).

For example, the processor 230 may extract from the database 250 the21^(st) camera position information P21B corresponding to the sixth userinput U6B.

The communication interface 220 receives the second camera informationfrom a second camera corresponding to the second camera positioninformation (S1171).

For example, the communication interface 220 may receive the secondcamera information from the second camera not configured to recognizethe object corresponding to the 21^(st) camera position informationP21B.

Then, the processor 230 extracts at least one second camera timeinformation and at least one second camera image informationcorresponding to at least one second camera position information fromthe second camera information (S1181).

For example, the processor 230 may extract from the database 250 the21^(st) camera time information T21B and the 21^(st) camera imageinformation corresponding to the 21^(st) camera position informationP21B from the second camera information.

Meanwhile, the user interface 240 receives a user input for selecting anarea other than an area of the time bar where the first camera timeinformation is displayed (S1152).

For example, the user interface 240 may receive a seventh user input U7Bfor selecting an area between the 11^(th) camera time information T11Band the 12^(th) camera time information T12B of the second screen 1220.

The processor 230 extracts, from the database 250, second camera timeinformation corresponding to the user input (S1162).

For example, the processor 230 may extract, from the database 250, the21^(st) camera time information T21B corresponding to the seventh userinput U7B.

The communication interface 220 receives the second camera informationfrom the second camera corresponding to the second camera timeinformation (S1172).

For example, the communication interface 220 may receive the secondcamera information from the second camera not configured to recognizethe object corresponding to the 21^(st) camera time information T21B.

Then, the processor 230 extracts at least one second camera positioninformation and at least one second camera image informationcorresponding to at least one second camera time information from thesecond camera information (S1182).

For example, the processor 230 may extract from the database 250 the21^(st) camera position information P21B and the 21^(st) camera imageinformation corresponding to the 21^(st) camera time information T21Bfrom the second camera information.

Then, the processor 230 further displays the second camera positioninformation on the map of the first screen 1210 and the second cameratime information on the time bar of the second screen 1220 (S1190).

For example, the processor 230 may display the 21^(st) camera positioninformation P21B on the map of the first screen 1210 and the 21^(st)camera time information T21B on the time bar of the second screen 1220.At this time, the 21^(st) camera position information P21B may bedisplayed to be distinguished from the 11^(th) camera positioninformation P11B and the 12^(th) camera position information P12B, andthe 21^(st) camera time information T21B may be displayed to bedistinguished from the 11^(th) camera time information T11B and the12^(th) camera time information T12B.

FIG. 13 is a flowchart illustrating an image processing method accordingto an embodiment.

Referring to FIGS. 1, 2, 9, and 13, when the user interface 240 receivesa user input for selecting predetermined position information (S1310),the processor 230 reproduces predetermined camera image informationthrough the third screen 930 in response to the user input (S1320).

For example, when the user interface 240 receives the first user inputU1B for selecting the 11^(th) camera position information P11B displayedon a map of the first screen 910, the processor 230 may reproduce firstcamera image information through the third screen 930 in response to thefirst user input U1B.

For example, when the user interface 240 receives the second user inputU2B for selecting the 11^(th) camera time information T11B displayed ona time bar of the second screen 920, the processor 230 may reproduce thefirst camera image information through the third screen 930corresponding to the second user input U2B.

According to the embodiments of the present disclosure, it is possibleto display a map representing a position where an object isphotographed, a time bar representing a time at which the object isphotographed, and an image of the photographed object on differentscreens simultaneously. However, as the inventive concept is not limitedto the above embodiments, the screens respectively displaying the mapand the time bar may be implemented in many different forms to displayposition information an time information without using the map and thetime bar.

Therefore, security may be further strengthened, and a security systemaccording to user convenience may be provided.

It should be understood that embodiments described herein should beconsidered in a descriptive sense only and not for purposes oflimitation. Descriptions of features or aspects within each embodimentshould typically be considered as available for other similar featuresor aspects in other embodiments.

While one or more embodiments have been described with reference to thefigures, it will be understood by those of ordinary skill in the artthat various changes in form and details may be made therein withoutdeparting from the spirit and scope of the disclosure as defined by thefollowing claims.

What is claimed is:
 1. An image processing apparatus comprising: adisplay configured to display at least one screen; a communicationinterface configured to receive camera information from at least onecamera; a processor configured to: extract at least one positioninformation, at least one time information, and at least one imageinformation corresponding to one another from the camera information;and generate a first screen displaying the at least one positioninformation, a second screen displaying the at least one timeinformation, and a third screen for displaying the at least one imageinformation; and a user interface configured to receive a user input forselecting at least one of first position information from the at leastone position information, and receive first time information from the atleast one time information, wherein the processor is further configuredto extract, from the at least one image information, first imageinformation corresponding to at least one of the first positioninformation and the first time information, and reproduce the firstimage information through the third screen.
 2. The image processingapparatus of claim 1, wherein the at least one position information isdisplayed in a form of a map.
 3. The image processing apparatus of claim1, wherein the camera is a movable camera.
 4. The image processingapparatus of claim 1, wherein the processor is further configured toextract at least one object from the at least one image information, andgenerate a fourth screen displaying the at least one object, wherein theuser interface is further configured to receive a user input forselecting a first object from the at least one object, and wherein theprocessor is further configured to extract second image informationcomprising the first object from the at least one image information andreproduce the second image information through the third screen.
 5. Theimage processing apparatus of claim 4, wherein the processor is furtherconfigured to extract second position information corresponding to thesecond image information from the at least one position information,extract second time information corresponding to the second imageinformation from the at least one time information, update the firstscreen such that the second position information is displayed thereon,and update the second screen such that the second time information isdisplayed thereon.
 6. The image processing apparatus of claim 5, whereinthe processor is further configured to update the first screen such thata position corresponding to only the second position information isdistinguishably displayed thereon among the at least one positioninformation, and update the second screen such that a time pointcorresponding to only the second time information is distinguishablydisplayed thereon among the at least one time information.
 7. The imageprocessing apparatus of claim 1, further comprising a database storingcamera position information, wherein the camera information receivedfrom the at least one camera comprises first camera information receivedfrom a first camera configured to recognize an object, and second camerainformation received from a second camera not configured to recognizethe object, an wherein the processor is further configured to: extract,from the first camera information, at least one first camera positioninformation, at least one first camera time information, and at leastone first camera image information corresponding to one another;extract, from the database, at least one second camera positioninformation indicating a position of the at least one second camerapositioned within a predetermined distance from a position of the atleast one first camera indicated by the at least one first cameraposition information; extract, from the second camera information, atleast one second camera time information and at least one second cameraimage information corresponding to the at least one second cameraposition information; display, on the first screen, the at least onefirst camera position information and the at least one second cameraposition information; display, on the second screen, the at least onefirst camera time information and the at least one second camera timeinformation; and display, on the third screen, the at least one firstcamera image information or the at least one second camera imageinformation.
 8. The image processing apparatus of claim 7, wherein theat least one first camera and the at least one second camera arestationary cameras.
 9. The image processing apparatus of claim 7,wherein the at least one first camera position information and the atleast one second camera position information are displayeddistinguishably from each other on the first screen, and wherein the atleast one first camera time information and the at least one secondcamera time information are displayed distinguishably from each other onthe second screen.
 10. The image processing apparatus of claim 7,wherein the processor is further configured to: extract the object fromthe at least one first camera image information; determine a movingdirection of the object; and extract, from the database, the at leastone second camera position information indicating a position of the atleast one second camera positioned within the predetermined distance inthe moving direction of the object from a position of the at least onefirst camera indicated by the at least one first camera positioninformation.
 11. An image processing apparatus comprising: a databasestoring camera position information; a display configured to display atleast one screen; a communication interface configured to receive firstcamera information from at least one first camera configured torecognize an object, and receive second camera information from at leastone second camera not configured to recognize the object; and aprocessor configured to: extract, from the first camera information, atleast one first camera position information, at least one first cameratime information, and at least one first camera image informationcorresponding to one another; extract, from the database, at least onesecond camera position information indicating a position of the at leastone second camera positioned within a predetermined distance from aposition of the at least one first camera indicated by the at least onefirst camera position information; extract, from the second camerainformation, at least one second camera time information and at leastone second camera image information corresponding to the at least onesecond camera position information; and generate a first screendisplaying the at least one first camera position information and the atleast one second camera position information, a second screen displayingthe at least one first camera time information and the at least onesecond camera time information, and a third screen for displaying the atleast one first camera image information or the at least one secondcamera image information.
 12. The image processing apparatus of claim11, wherein the object is at least one of a license plate number of avehicle, a face, a voice, and a sound having a predetermined frequency.13. The image processing apparatus of claim 11, wherein the at lease onefirst camera and the at least one second camera are stationary cameras.14. The image processing apparatus of claim 11, wherein the at least onefirst camera position information and the at least one second cameraposition information are displayed distinguishably from each other onthe first screen.
 15. The image processing apparatus of claim 11,wherein the at least one first camera time information and the at leastone second camera time information are displayed distinguishably fromeach other on the second screen.
 16. The image processing apparatus ofclaim 11, wherein the processor is further configured to: extract theobject from the at least one first camera image information; determine amoving direction of the object; and extract, from the database, the atleast one second camera position information indicating a position ofthe at least one second camera positioned within the predetermineddistance in the moving direction of the object from a position of the atleast one first camera indicated by the at least one first cameraposition information.
 17. The image processing apparatus of claim 11,further comprising a user interface configured to receive a user inputfor selecting an area other than an area of the at least one firstcamera position information on the first screen, wherein the processoris further configured to extract, from the database, the at least onesecond camera position information corresponding to the selected area,in response to the user input.
 18. The image processing apparatus ofclaim 11, further comprising a user interface configured to receive auser input for selecting an area other than an area of the at least onefirst camera time information on the second screen, wherein theprocessor is further configured to extract, from the database, the atleast one second camera position information corresponding to theselected area, in response to the user input.
 19. The image processingapparatus of claim 11, further comprising a user interface configured toreceive a first user input for selecting the at least one first cameraposition information or the at least one second camera positioninformation displayed on the first screen, and a second user input forselecting the at least one first camera time information or the at leastone second camera time information displayed on the second screen,wherein the processor is further configured to reproduce the at leastone first camera image information or the at least one second cameraimage information through the third screen in response to the first userinput, and reproduce the at least one first camera image information orthe at least one second camera image information through the thirdscreen in response to the second user input.
 20. An image processingmethod comprising: storing camera position information in a database;receiving first camera information from at least one first cameracapable of recognizing an object, and receiving second camerainformation from at least one second camera not configured to recognizethe object, by using a communication interface; extracting, from thefirst camera information, at least one first camera positioninformation, at least one first camera time information, and at leastone first camera image information corresponding to one another, byusing a processor; extracting, from the database, at least one secondcamera position information indicating a position of the at least onesecond camera positioned within a predetermined distance from a positionof the at least one first camera position indicated by the at least onefirst camera position information, by using the processor; extracting,from the second camera information, at least one second camera timeinformation and at least one second camera image informationcorresponding to the at least one second camera position information, byusing the processor; and generating a first screen displaying positioninformation comprising the at least one first camera positioninformation, a second screen displaying time information comprising theat least one first camera time information, and a third screen fordisplaying the at least one first camera image information, by using theprocessor.